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Abstract. We introduce a self-organized model of graph evolution associated with 
preferential network random walkers. The idea is developed by using two different 
types of walkers, the interactions of which lead to a dynamic graph. The walkers 
of the first type cause an enhancement in link attachments, while the second types 
have a destructive behavior. The statistical properties of the resulting network, 
including weight distributions, clustering, spectral densities and average path length 
are evaluated. As the ratio of the population of two types is balanced, the network 
faces a phase transition. We show that in the transition point, the graph behaves as a 
scale- free network, with a scaling exponent of ~ —1.7. 
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1. Introduction 

Complex systems in nature and technology, ranging from neural networks to the World 
Wide Web, are well described by complex network theory [H [2], [3]. There have been 
some efforts to describe the behavior of several real-world networks, such as cells, nervous 
systems, social organizations, etc., by means of graph theory [H El E]. The elements 
of such systems are represented as nodes of a graph, while the interactions among 
the elements are modeled by the graph's edges. The strengths of the interactions are 
considered to be the edges' weights. For example, a cell [7] is described by its chemicals. 
The interactions among these chemicals are the chemical reactions. In case of a nervous 
system [8], the nodes are nerve cells, connected by axons. In social networks [9], the 
organizations and their connections can also be modeled by nodes and edges of a graph, 
respectively. 

A random graph is an ensemble of N nodes that are randomly attached together. 
Each two nodes in the ensemble are connected together with a certain probability. It 
is observed that as the number of nodes in a random graph is increased, the degree 
distribution takes a Poisson [TQl HI]. Although random graphs are perfect solvable 
models, because of wrong clustering, and also unrealistic Poisson degree distribution, 
they deviate from real network systems [12]. Recent studies have revealed that many 
real-world networks behave as scale-free. The evolution of these networks has roots 
in two mechanisms; the network growth and preferential attachment [TJ HJ [13]. For 
example, in the World Wide Web it is observed that the more linked the elements are, 
the more they prefer to have links to other elements [H]. This behavior is called the 
preferential attachment, which is not included in random graph theory. 

The construction of a graph is concerned with the algorithm of network growth. 
Depending on the structure of this algorithm, the resulting network can be categorized 
into several topological groups [IS], including Erdos network, scale- free networks and 
small-world networks. In an Erdos random graph certain numbers of links are selected 
randomly among all potential edges. The degree distribution P(ki = k) is the probability 
that the node i has k links. For different nodes i and j, P(k = ki) and P(k = kj) are close 
to being independent random variables. Hence, it suffices to determine the number of 
nodes with degree k, Xk, and then P{k) = X^j ^2 k Xk. For random graphs, the degree 
distribution is a binomial, and if the number of nodes N is large, the distribution is 
Poisson P . 

In comparison to an Erdos random graph, in which attachment of each particular 
node is uncorrelated to its degree, a scale-free network is concerned with preferential 
attachment. Recent studies [16], regarding construction of a scale-free network, reveal 
that the degree distribution in such networks is shaped with a power-law tail. The 
measure characterizing the neighborhood structure of the network is the clustering 
coefficient, i.e., the number of triangles, which are connected to one vertex [T7j. Being 
inspired by clustering, we can discuss a class of networks, that although the most 
nodes of which are not neighbors, average path lengths between the nodes are short. 
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This type of network is called small-world. The average distance between nodes for a 
small-word topology, after a cross-over size, grows logarithmically as the network's size 
grows [HKD EH]. 

In this paper, we propose a model of a dynamic graph, in which the dynamics 
is due to the mobility of random walkers. In order to have the network evolve, we 
used two types of walkers; the walkers of the first type (constructive walkers) tend to 
enhance the transition probabilities of the links they have just walked through, while the 
walkers of the second type (destructive walkers) have a decreasing effect. We examined 
the statistics of link attachment probabilities (transition rate) and the popularity of 
the edges (traffic rate), as the graph evolves. The results reveal that although local 
variables critically depend on initial conditions, global parameters are self-organized 
and completely independent of initial conditions. Depending on the ratio of the walkers' 
populations (number of constructive walkers to the number of destructive walkers) due 
to a phase transition, the evolved network in its steady state is categorized in three 
states. We show how scaling in weight distributions emerge, as the network reaches to 
its critical point of transition. 

This modeling can be applied to several different physical systems concerning 
dynamic interactions among elements. There are several real systems in which elements 
have similar properties as those of constructive walkers. For example, the dynamics of 
synaptic weights which are assumed to be the principal mechanism of memory storage 
in nervous systems, are believed to obey Hebb's law, "the cells which fire together will 
tend to wire together" [20, ETJ • Transportation systems can also be modeled by this 
dynamic random walk, since the popular pathways in such systems tend to absorb 
more populations [22]. Moreover, the effects of destructive walkers struggling with 
constructive ones, are realizable in a variety of applications. Using this modeling one 
can study the propagation of two different types of substances through a network of 
pipelines. The first type of substance tends to sediment through the pipe, while the 
second type tends to facilitate the propagation of water. 

2. The model 

The model introduced in this paper is based on random walk of walkers on an interactive 
dynamic graph [23]. We start with a fully connected network of N nodes. We 
put some random walkers on the network. At any time-step, each walker chooses 
one of its neighbors with a certain probability and transits to the chosen neighbor. 
The walkers are considered to be of two classes. The first class is called constructive 
(CW), and the second class is called destructive (DW). The former tends to enhance the 
transition probability of the link it has just walked through, while the latter decreases 
this probability. 

The dynamics of the proposed network emerges during the following procedure: 
primarily, a graph consisting of N nodes has a fully connected transition probability 
matrix, i.e., the probability of transition between each distinct pair of nodes is equal to 
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-^-j- (Vz, j G {1 . . -N}, if i 7^ j then p^ = 1/(N — 1)). At every time-step, a walker 
selects an edge for transition; the probability of transition through the chosen edge 
encounters a small change. If a constructive walk happens to transit from node i to 
node j, the transition probability of the selected link evolves as the following rule: 

and for destructive walkers, 

D : Pij (t + ^) = v 1 %Tl / (TV W 

Eme^lPi.mW) + l/e.pijit) 

Where equation [1] and [2] describe the dynamics of element ij of the transition 
probability matrix as a CW or DW transits through link ij, respectively, e is called the 
attachment factor; a constant which its value is essentially close to l(e = 1 + e,e <C 1). 
Pij (t) is the probability of transition from node i to node j at time t. Fj is the set of all 
nodes {m ^ j}, that are not occupied by any walkers. It should be mentioned that due 
to the normalization condition, the transition probabilities assigned to the links attached 
to each node must sum up to unity. Hence, the transition probabilities of the remaining 
links must be divided by the denominator of equations [1] and for transition of a 
CW and a DW, respectively. Therefore, the expectation value of transition probability, 
assigned to link ij becomes: 

(e — l)pij ^> Pik 

Pij\c = PijKTTl T\ — + Z^TT1 r\ — )> ( 3 ) 

1 + (e - l)Pij 1 + (e - ljpik 



and 

„..,„ = „..( ( 1 / e ~ 1 )^ + y 



fc=l 



Where Pr/|c i s the conditional expectation value of the transition probability 

for link ij, considering the condition that a CW (DW) has transited from node i. It is 
assumed that only one walker can pass any link at time, which is a good approximation 
for low walker concentration. 

In the proceeding sections after an analytical evaluation, order, disorder and graph 
states are discussed. Afterwards, the statistics of the network is realized by examining 
two different weight matrices. Transition rate matrix (T) is introduced as a dynamic 
weight matrix, describing attachment probabilities among nodes. Each element of T(t), 
7ij(t), is equal to the transition probability (pij(t)) divided by the unit time-step (St), 
lij = Pij I St. In order to investigate the traffic rate of walkers corresponding to each 
particular link, the traffic rate matrix Q is introduced. Elements of Q, (ooij) are the 
average population transited through link ij, in the steady state over a sufficiently large 
period. Traffic rate is the measure of popularity among edges. 
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2.1. Analytical evaluation 

The dynamics of the transition probability matrix P(N x N) can be evaluated 
by considering the expectation value of its elements Pij(t), after each transition. 
Considering Pc.i{t) as the probability that a constructive walker is in node i, at time 
t, and PD,i{t) as the corresponding probability for destructive walkers, the expectation 
value of the evolved transition probability, Pijit + St), can be written as: 

Plj (t + St) = Pijlc (t)PcM + Pij\D(t)P Dji {t) (5) 
+ (l-(P c>i (t) + P Dti (t))) Pij (t). 

Here Pij\c(t) and Pij\D{t) are the conditional expectation values of transition probability, 
for t + St (equations [3] and H]). Using continuum theory [2l] for thermodynamic limit, 
the dynamics can be written as two coupled differential partial equations. Assuming 
low concentration walker approximation (at iV — > oo), along with the condition that 
attachment factor be essentially close to unity (e = 1 + e,e < 1), these equations can 



be written as (see Appendix A): 



dt 

and 



EtypijTiiipij - Ma), (6) 



Where St is the time interval between each transition, r)(N x 1) is a vector with its 
elements i]i = P C: i — Po,i, and E{t) = lim^o jr = = 1) is a control parameter, 
which is assumed to be constant. Ma is the ith diagonal term of the matrix M = PP T . 
P T is the transpose of the transition probability matrix. I(N x N) is the identity matrix. 

Equation [6] is a non-linear partial differential equation, which is not simply solvable 
analytically. According to the results which are demonstrated in the proceeding parts 
(see 12.21) . it is observed that when the population of CWs is less than the population of 
DWs, the network is given by high degree of order. This regime is called the ordered 
regime. As the number of DWs exceeds the population of CWs, the network happens 
to face a phase transition. The resulting state of the network in the steady state has 
relatively high disorder in transitions. This regime is called the disordered state. A 
stationary state is called global, if the conditions for the links being in stationary state 
are satisfied for all the local components of the network. Depending on the state of the 
network, two global stationary states for equations [6] and [7] are found to be attractive 
(see Appendix B ): 

a. For every node i, there exist a node j ^ i such that p^- = 1, and for all 
k ^ j,Pik = 0. If the distribution of elements of r] be uniform, this global stationary 
state is attractive at the ordered regime, and repulsive in the disordered state of the 
network. 

b. For every node % and every node j ^ i, pij = 1/(N — 1). If the distribution 
of elements of rj be uniform, this global stationary state is attractive at the disordered 
state, and is repulsive in the ordered state of the network. 
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Network reaches steady state, if drj/dt = 0. Since every column of matrix P sums 
up to unity, a steady state for the network is when there exist a constant t] < 1, such 
that Vi,j G {1 . . . N},t]i = rjj = t]q (equation [7j). In the thermodynamic limit, when 
every ensemble is given by same probability, if the walkers are distributed uniformly 
among nodes, the steady state value of rj is equal to rjo — 2x — 1; x which is called the 
concentration of constructive walkers, is the ratio of constructive walkers to the total 
number of walkers. As x is increased from x < 1/2 to x > 1/2, in the steady state, the 
right-hand side of equation 6 changes its sign; hence, there is a phase transition at the 
critical point x = 1/2. 

2.2. Entropy, order parameters and phase transition 

The average Shannon entropy [25] quantifies the average uncertainty a walker has in 
selecting an edge, as it happens to transit from a randomly selected node. This quantity 
which determines the correlation between disorder in network and the types of walkers 
is written as: 



Pij is the probability of transition from node i to node j, in the steady state. As stated 
previously, the argument x (concentration of constructive walkers) is the ratio of CWs' 
population (n c ) to the total number of walkers (m), x — — . 

As the transition probabilities for edges connected to one node sum up to unity 
Pij = 1, then ^2ij Pij — N. If we introduce the order parameter as the following: 



For a > 1 it counts the influence of high weighted links. For a — > oo, /i approaches 
to the number of links that has a probability equal to 1. 

The model for a graph containing N = 100 nodes, and a fixed total number of 
walkers m = 30, with factor e = 1.1, is simulated for several concentrations of CWs. 
The simulation results for the above-mentioned parameters reveal that in agreement 
with results from analytical evaluation (12.11) . there is a clear condensation [26] phase 
transition, when the populations of the two types of walkers are equal, x = 0.5. 
The resulting plots corresponding to the average entropy and several order parameters 
(a = 2,4,8) are depicted in Figure [TJ Depending on the value of x, the graph is 
categorized in three states: the ordered state (O-State: x > 0.5), the disordered state 
(D-State: x < 0.5), and the transition state (T-State: x ~ 0.5). As the curve shows, 
the system goes ordered with low entropy, at x > 0.5; and transits to the D-State 
for x < 0.5, which is given by relatively high entropy. This shows, however, while 
constructive walkers try to build a few high-traffic links in the networks, the destructive 
walkers tend to make them uniform. 

In order to examine the functionality of the average entropy with respect to the 
size of the network, this quantity is calculated for several network sizes, for several 
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Figure 1. a) The average Shannon entropy as a function of constructive walkers 
concentration, x. There is a clear phase transition at x — 0.5. b) The order parameter, 
/i(x, a), as a function of x is sketched for three given values of a, (red) circles for a = 2, 
(black) squares for a = 4, and (green) triangles for a = 8. The graph contains N = 100 
nodes and m = 30 walkers, with e = 1.1. The results are obtained after the systems 
approached steady state. The solid curves are plotted just as eye guides. 
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Figure 2. Average Entropy for fixed walker concentrations shows logarithmic growth 
with the network size. Here, the results for two concentrations, x = (red) circles, 
and x = 0.3 (blue) squares, are presented. The inset diagram shows deviations from 
the logarithm of network's size. 




Figure 3. Order parameter for a = 2 in three observed states of the network; a) 
the disordered state with x = 1/30, b) the transition state with x = 15/30, and c) 
the ordered state of the network, with x = 27/30. The system shows a slow down 
relaxation in transition state (as expected). The relaxation time for (c) is t ~ 5000 
times-steps and for (a) is t ~ 10000. But it is not relaxed in transition state, even after 
t = 400000 time steps. 
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Figure 4. Transition rate (a) and traffic rate (b) distributions for some different 
values of concentrations, x 6 [0,0.5]. It is clear that as x approaches to its critical 
point x = 0.5, scaling in the weight distributions emerges. 



concentration of CWs. The simulation data reveals that the average entropy of the 
networks with small x grows logarithmically with respect to the network's size. This 
result is depicted in Figure |2j The inset diagram of Figure |2] is the deviation of average 
Shannon entropy of the network from natural logarithm of network's size (ln(iV) — S). 
According to this result average Shannon entropy has a dominant term equal to ln(iV), 
and as x is increased, deviation from this dominant term increases. 

3. The statistical properties 

The statistics of transition rate and traffic rate among links, in the three previously 
stated regimes, are evaluated using the weight distributions, spectral densities, average 
clustering coefficient, and average path length. We used several transition rate and 
traffic rate distributions to demonstrate the directional connectedness for each edge and 
popularity among edges, respectively [2?]. To extract the results, we wait until the 
network approaches to the steady state. We suppose the system in the steady state, 
when the time-dependent second-order parameters (/x(x,2)), as macroscopic variables 
indicating the influence of highly weighted links, are saturated. As it is demonstrated in 
Figure [31 the at the critical point of transition (T-State) system does not relax even after 
a long period of time. For the O-State and D-State the relaxation in network is after a 
finite time steps. According the ratio of the different walkers in the network, the system 
converges to three different states; the ordered, the disordered, and the transition states: 
D-State (x > 0.5). This regime is constructed by dominant effect of DWs. The 
properties of the network for this state are mostly like an almost connected network, 
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Figure 5. The traffic distribution on the network, in the steady state, for the ordered 
state in a 100 x 100 network. The vertical axis is the population transited from the 
node i to node j. 

with distributions alike to a random graph. The fully connected network in this regime 
is stable. 

T-State (x ~ 0.5). In this regime, the number of both types of walkers is the 
same (x = 0.5). As the CWs transit through m/2 of edges, these links will be given by 
increased transition probabilities, and therefore destructive walkers, which have equal 
populations up = ric, will be absorbed to these edges. Hence, the walkers interact so 
strongly. Figure H] demonstrates the emergence of scaling, as x increases from small 
values (x < 0.5) to x = 0.5. 

O-State (x > 0.5). This state of the network is constructed by dominant effect 
of CWs. Most of the traffic transferred within the network, is distributed among a few 
links. Since x > 0.5, a positive value for r\i is expected, and the initial fully connected 
network is repulsive. The CWs in the system tend to direct the traffic through a few 
graph links and therefore, destroy the rest, and as a consequence, detached sub-graphs 
appear. As demonstrated in Figure [5j in the steady state, the traffic is located among 
a few numbers of edges. 

3.1. Weight distributions 

Weight distributions for the three states of the network are demonstrated in Figure 
EJ For both traffic and transition rates in the D-State, the distributions are alike to a 
Gaussian distribution. As x is increased from x = to x = 0.5, a power-law tail for the 
distributions appears (Figure Hj). The destructive walkers tend to construct a random 
graph. As the network transits from D-State to the T-state (x = 0.5), the distributions 




Figure 6. Weight distributions for the three states of the network are sketched. The 
total number of walkers to the size of the network are kept fixed on m/TV = 0.3. In 
(a) and (b) TV = 100 and x = 3/30, in (c) and (d) TV = 500 and x = 75/150, and 
in (e) and (f) TV = 100 and x = 27/30. In ordered state, while we see a scale free 
behavior for transition rates, the traffic is localized in a few alive links. On the other 
hand, both the rates show normal distributions in the disordered phase. Power-law 
distributions of the rates in the transition state show that the network in its critical 
point, is scale free. The best power-law fits on the data are shown with black lines with 
the slope of —1.7 for (c) and —1.4 for (d). The linear branch of transition distribution 
for ordered state also fits best on a power-law with a slope of —2.15. The inset shows 
the comparison diagram for the rates. As one can see, there are a strong correlation 
between the rates in transition state with a regression equal to R = 0.994. 
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Figure 7. Statistical properties of the network, as a function of concentration of 
constructive walkers. In all the graphs, (red) stars show the result for transition rate, 
and (blue) circles are for traffic rate. In (a) the average rates are shown as a function 
of x, (b) shows the standard deviation for the rate distributions, and (c) shows the 
principal eigenvalue of the adjacency matrix. 



for both transition rate and traffic rate take a power-law tail with factors 1.7 and 1.4, 
respectively. Transition rate distribution at this critical point (x = 0.5) includes several 
singular spots for high weights in the tail. The transition rate distribution in the O- 
State, includes a linear branch with power-law distribution with an exponent varying 
between 1.7 and 2.2. As the value of CWs concentration is increased, the slope of the 
power-law branch increases monotonically. At the end of the tail of the power-law there 
are many singularity spots related to highly weighted links. The traffic rate consists 
distribution consists of highly weighted singular links. 

In order to investigate the similarity among transition rate and traffic rate 
distributions, the linear dependency between them is examined. Considering weight 
matrix W assigned to the network, the number of links with their weights w = Wq is 
written as N(w = Wq). A normalized weight is defined as W = WJ max(W) . The 
inset diagrams of Figure [6] are called the comparison diagrams. Each point in the 
insets corresponds to a particular value of 7 = Cj. The vertical axis is the number 
(N(Cj)) of links associated to normalized traffic rate (Cj), and the horizontal axis is the 
number (N(^f)) of links associated to the normalized transition rate (7 = Cj). Traffic rate 
distribution in the O-State consists of several singularities, associated to highly weighted 
links. The transition rate distribution, along with the singular links, includes a linear 
branch in logarithmic scale. The calculated regression for the comparison diagrams in 
the D-State and the T-State are R = 0.298 and R = 0.994, respectively. This result 
shows that for the T-State of the graph, both distributions take similar shapes; for D- 
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State, although both distributions are fitted to a Gaussian, their curve in comparison 
diagram deviates from line. 

3.1.1. Constructive walkers and Network Branching By the dominant effect of DWs, 
the network tends to become fully connected. As x is increased, the variance for 
distributions expands monotonically (see Figure [7]), and for a pure DW population 
(x = 0) the distribution's shape is a simple Gaussian. According to simulation results 
from the D-State, as the population of CWs increases, the traffic rate distribution 
deviates from a simple Gaussian. As it is demonstrated in Figure El the distribution 
branches into two overlapping Gaussian distributions, with same averages and standard 
deviations satisfying j7~^^b ^ 1; with Ui {% — 1, 2) being the standard deviations for 
distribution branches. We call this behavior the network branching. This phenomenon 
is due to the correlations between the CWs and the DWs. As the population of CWs 
increases, interactions between walkers become significant. Hence, the CWs interact 
with a couple of DWs. When CWs pass certain links, a number of DWs are absorbed to 
these edges. As the DWs transit through these links, the transition probability for the 
selected links reduces, and the rest of the DWs transit through fewer selective edges. 
Therefore, the network's geometry crashes into two weak interacting sub-graphs. 



3.2. The spectral properties 

To every network (G), we can assign an adjacency matrix A(G), which represents the 
connectivity between vertices. Adjacency matrix is a N x iV matrix, with elements 
Aij = Aji, nodes i and j are connected if and only if Ay = 1 and = 1. For a 
network consisting of N nodes, the adjacency matrix has N eigenvalues Xj,j G {1 . . . N}. 
The spectral density is the distribution of the eigenvalues. In mathematical terms, the 
spectral density is defined as: 

1 - 

= ( 10 ) 

This summation as iV — > oo, approaches to a continuous function. As Wigner ( 
[30] ) had stated, for the case of a random graph of N nodes with p as the 



probability of attachment, if |A| < 2\J Np{l — p) the eigenvalue distribution takes a 
semi-circular shape as: 



a/ ANpjl -p) - X 2 
P(A) = 2nNp(l-p) • 

The value of p for | A| > 2^jNp{l — p) is zero, except for several eigenvalues localized 
far from the center of the semi-circle. This is also known as the semi-circular law. The 
largest eigenvalue is called the principal eigenvalue, which plays an important role in 
topological features of the network pp. 

According to several works J3TJ [32] for scale-free networks, the spectral density 
takes a triangular shape, with its top lying high above the semicircle. Due to the nodes 
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localized with high degrees in a scale-free network, the margins decay as a power-law. 
In scale-free networks, the principal eigenvalue defines the network's loop structures. 
We used a rounding procedure to assign an adjacency matrix to the network. For W as 
a weight matrix, the symmetric part of W is defined as W s = \{W + W T ), which W T 
is the transpose of W. This symmetric weight, represents the average non-directional 
strengths of connectedness among nodes. The adjacency matrix A(W) is constructed 
by comparing W s with average symmetric weight W s = (2/N(N — 1)) W*j , i.e., if 
W?j > W s the corresponding adjacency matrix is assigned to be 1 (A(W)ij = A(W)ji = 
1), and otherwise 0. 

3.2.1. Results We have used the symmetric traffic rate and transition rate matrices. 
For the T-State, the eigenvalue distribution is a triangular shape, and the topology 
of the network is scale-free (see Figure 0-a). The results for the D-State (Figure 0- 
b), reveal that the spectral density is a semi-circular shape, and the topology of the 
network is similar to a random graph. By comparing the results for the network in the 
D-State with an Erdos network, it is observed that the spectral density function fits to a 
random graph with attachment probability equal to p — 0.275. In order to demonstrate 
the topology transition as the concentration x evolves, the behavior of the principal 
eigenvalue, average weights and standard deviation of weights from the mean amount 
are depicted function of x in Figure [7J 
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Figure 8. The traffic rate distribution is sketched for disordered state at x = 3/30 
for a network consisting of N = 100 nodes. The distribution consists of two clear 
branches. This branching is due to the correlations among constructive walkers and 
destructive walkers (see the text). 
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Figure 9. The spectral density transition rate (a) for a network in its critical point 
(x = 0.5). The network consists of TV = 500 nodes with m = 150 random walkers. The 
inset depicts the margin in log-log. It is compared with the spectral densities for the 
network in ordered and disordered states in (b). Also a solid curve compares it with 
the best fit to the spectrum of an Erdos graph. 

3.3. Clustering and average path length 

Further topological features of the network, in the three states, are examined using 
average clustering coefficient and average minimum path. In the following, after 
indicating our approach, the results corresponding to average clustering coefficient and 
average distance between nodes in several CWs concentrations are demonstrated. 

3.3.1. Clustering Clustering coefficient is the measure that determines how nodes in 
the neighborhood of a specified node interact together. In general, this measure is 
equal to the fraction of triangles surrounding a node to the total potential triangles 
within the node's neighborhood. Recently, clustering coefficient has been modified 
for weighted networks. Depending on the modeling, there are several candidates for 
the definition of clustering coefficient. Several definitions have been introduced, that 
through their definitions, the neighborhood structures, adjacency matrix or strength of 
the nodes is used to define the clustering coefficient (Lopez- Fernandez (2004), Barrat, 
Onnela [22l 133] ) . In some definitions, since the definition requires an underlying binary 
network to be generated, rounding procedures concerning threshold parameters are used 
(Rougemont and Hingamp 2003 [271 H3 EU ESI [36]). We have focused on the definition 
of Zhang and Horvath, which was traced back to the earlier work of Grinlord. The 
advantage of this procedure is that it deals directly with normalized weights, and does 
not need the weights to be rounded to or 1. Furthermore, in the procedure, the 
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Figure 10. The average clustering C(x) and the average path length I as a function 
of x for a network consisting of TV = 100 nodes with m = 30 and e = 0.1 (a). For both 
traffic rate, (blue) circles, and transition rate, (red) stars, network has high clustering 
feature in the disordered state and as x is increased, average clustering coefficient 
decreases monotonically. In ordered state almost for all concentrations network has 
trivial average clustering. But the average path length shows is peaked for both the 
rates around the transition state. To find the average path length in ordered states we 
just looked at inside the isolated islands. 



clustering coefficient is defined only by using the weights. 

In Zhang-Horvath's definition, for W as the weight matrix assigned to the network, 
the weights are normalized to max(W^), and the clustering coefficient for node k is 



written as: 



C HZ (k) = ^ \ 3 \ (12) 



Where W is the normalized weight matrix 



3.3.2. Average minimum path By definition, the distance from node i to node j in the 
graph is the minimum number of possible connected links that originate from node % 
and terminate to node j. Minimum path can be defined using normalized weights. We 
used the Floyd- Warshall Algorithm [37] for weighted networks. The algorithm consists 
of three steps: 1) For W(N x N) as the weight matrix, every weight is normalized 
to max(W / ), and the distance between every adjacent pair of nodes i,j is defined as 
dij = , where W is the normalized weight matrix. 2) The diagonal elements of the 
distance matrix are assigned zero (diag(d) = 0). 3) The distance between every pair 
of nodes i,j is assigned mirikei...N (dij,dik + dkj). This step is repeated iteratively for 
N times, and the final d matrix is the minimum path matrix. The normalized traffic 
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rate and transition rate matrices are used to specify the properties of the network with 
respect to clustering and average minimum paths. 

3. 3. 3. Results Figure [10] depicts the results regarding average clustering and average 
path length of the network. In the D-State with small x, both the traffic rate and 
transition rate networks are highly clustered. As x increased, the average clustering 
coefficient decreases monotonically. In the T-State and the O-State, the average 
clustering of the network is trivial. The characteristic length for both transition rate 
network and traffic rate networks in the D-State is small compared to the network's 
size. As x is increased, the average path length increases. In the T-State, the average 
minimum path reaches to a finite large amount. The O-State consists of several 
isolated sub-graphs, and the characteristic length for both traffic rate and transition 
rate networks is infinite. For these states, we have considered the average distance for 
each isolated clusters. The average over the clusters' average distances is considered as 
the average path length of the network. The average minimum path in the O-State and 
the T-State, are high above the average distances in the D-State. 

4. Summary 

We proposed a model of dynamic network with interactive random walkers. We consider 
the walkers to be of two classes, not interacting with each other, but have a trace on the 
links of the network. The walkers of the first type, which cause an enhancement in links' 
transition probabilities, are called the constructive walkers (CW), and the others, which 
cause a reduction in the transition probabilities, are called the destructive walkers (DW). 
In the limit of low walker concentration approximation, the analytical evaluation of the 
dynamics of the transition probability matrix results in two coupled partial non-linear 
differential equations (equations [6] and Ej). Depending on the relative concentration of 
the two types walkers, x, there are two different global stationary states for the network. 
When the constructive ones are dominant, the system approaches a singular network (O- 
state), with a few non- vanishing links which the traffic is concentrated on them. On the 
other hand, when the number of destructive walkers is higher, the network tends to be 
uniform (D-state). In the between, when the network is given by a balanced population 
of the walkers, a sharp transition from singular to uniform state is observed. The system 
in the transition state (T-state) shows clear characteristics of scale-free networks. To 
distinguish the phase transition, we introduce an order parameter ( equation [9]) which is 
tiny for an uniform network and counts the number of high traffic paths on the singular 
network. Also, we are able to look at average Shannon entropy of the network which 
accounts randomness in transition rates. As the network size increases, the average 
Shannon entropy in the D-State has a dominant term equal to the natural logarithm 
of network's size (S(N) oc ln(iV)), and as x is increased, the average entropy deviates 
from this functionality. We introduced the transition rate matrix, which its elements 
are the transition rate of the walker through the links, indicating the connectedness 
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among nodes. The traffic rate matrix, which its elements are the average population 
transited through links per unit of time-step (during a long period after the steady 
state), gives the popularity among edges. In D-State, both the transition and traffic rate 
distributions are almost Gaussian, with a spectral density well fitted to an Erdos random 
graph. By increasing the concentration of CWs, the traffic distributions branches into 
two overlapping Gaussian distributions. We called this phenomenon, which is caused 
by correlations between the walkers, the network branching. Regarding the spectral 
densities and the wight distributions, we found that network in the T-State is scale-free, 
with exponents —1.7 and —1.4 for transition and traffic rates, respectively. In the O- 
State also we see marginally scale-free behavior on transition rates with slope of —2.2. 
In this case, the traffic is catches in a few closed paths and is isolated from the rest of 
the network. Then, it does not show scale-free structure in steady state. The results 
regarding clustering and characteristic length of the network, reveal that the D-State 
has high clustering, and the short path lengths; while for the O-State and the T-State 
network consists of isolated clusters, and the average over the cluster's path lengths were 
observed to be high above the average lengths in the D-State. The introduced model 
can be applicable to many realistic models, and can explain the scale free features of 
dynamical networks, interacting with their elements. 
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Appendix A. The dynamics of transition probability matrix 

Using Taylor expansion, considering the first non-zero terms of e, equations CD and [2] will 
become: 

Pij\c = Pij (Pij(l + e) - ep% + Pik ~ e p ik) ' ( A - X ) 

k^j k^j 

Pij\D = Pij(Pij{l - e) + ep% + ^Pik + e Y p ik)- ( A - 2 ) 

k^j k^j 

Using the above equations, along with equation [51 the dynamics can be written as: 

Pij (t + 5t) = Pij (t) + e(P c ,i - P D ,i)Pv (Pij - J^Pik) ■ ( A - 3 ) 

k 

Using continuum theory, for evolution of networks [21] , after long enough time-steps in 
the limit AT — >• oo, ^ — > || (e = 1) = E(t), by defining r/i := Pc,i — Pd,i the dynamics 
becomes as: 

% = /•:(/)/',,//,(/',, - Ma). (A A) 
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Where, M is defined as M = PP T . Inspired from diffusion mechanism, we can write 
the dynamics for the evolution of rj(N x 1). Node i is connected to N — 1 nodes. At 
each time-step, if any walker is at node i, at the next time-step will transit to the 
other nodes, and new walkers transit to node i. For every node j ^ i a constructive 
(destructive) walker concentration probability equal to Pcj(Pdj) transits to node i, 
with a probability equal to Pji. Hence, the expectation value of Pc,i and Po,i, after each 
time-step evolves as the following recursive equations: 

Pa(t + 5t ) = ^PaWPcA*)' ( A - 5 ) 

and 

Since diagonal elements of transition probability matrix are zero, using continuum theory 
the dynamics of rj is as the following: 

Where St is the time step between transitions, P T is the transpose of transition 
probability matrix and I(N x N) is the identity matrix. During this work, we 
have considered E(t) constant and low walker approximation is assumed for all the 
simulations. 

Appendix B. Stationary states and stability 

The stationary state of the network is when the expectation value of the random 
variables pij does not evolve in time. If the stationary state happens to be unstable, 
after large enough time, the deviation of exact values obtained from simulation from 
expectation values (solution of equations M and [7]), lead the state of the network to 
completely deviate from the stationary solutions. Since the elements of P are the 
expectation values for transition probabilities, the zth column of probability matrix, 
vector = (p il; ... ; p iA r) T ; satisfies the following conditions: 



0< Plk < l,Vk£{l...N}, 
i 

Element p^ is in stationary state if 
implies: 

k 

or 

Pij = 0. 



(B.l) 
(B.2) 

= 0. Using equation El this condition 

(B.3) 

(B.4) 
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Equation IB.3I can be written as (p^ — 1/2) 2 + Ylk^jPik = (V^) 2 - The set of all 
possible vectors, p®, satisfying the third condition (equation IB.3|) is a N dimensional 
hypersphere with radius equal to |, centered at pij = \,Pi^j = 0. The set of all 
vectors satisfying equation IB. 21 is a N dimensional hyperplane. Hence, the set of all 
vectors satisfying the three conditions (equations IB. 11 IB. 21 and IB. 31) is the intersection 
of the hyperplane and hypersphere, satisfying pW £ [o, 1]^, which is a N — 1 dimensional 
hypersphere. The N — 1 dimensional hypersphere corresponding to the stationary state 
of node ij is expressed by A lJ . 

The global stationary state for node i is obtained when for every k ^ % 6 {1 . . . N}, 
Pik be in its stationary state. There are two global stationary states for the network: 

a) If equation IB.3I is satisfied for all destination nodes, this global stationary state 
is the intersection of all A lk hyperspheres. If pik = YljPlji be satisfied for all k ^ i, 
it reveals for all k, I ^ i G {1...N}, pik = pu- Hence, assuming the normalization 
condition this stationary state is Wk ^ i,p ik = 1/(N — 1). This stationary state is called 
the uniform stationary state. The variation of equation |6] is as: 

k 

+ rjiPiji^Apij - y^(2pi fc Ap ifc )))- 

Stationary state for node i is stable if A^-Apjj < . For uniform stationary state, 
the first part of the right hand side of equation IB. 51 is zero. The normalization condition 
implies Ap^ = 0. In steady state if the walkers be distributed uniformly among 
nodes, A^ 2 - = (j^)rjiA{pij) = (^)(2x — l)A(py). Therefore node i in steady state is 
stable when x < 0.5. 

b) The other stationary state for node % is when there exist a node j ^ i, such that 
Pij = 1, and hence due to the normalization condition, for all k ^ j,Pik = 0. In this 
stationary state, which is called the isolated stationary state, the first part of the right 
hand side of equation IB .51 is zero, for the high weighted link (p^ = 1), and in steady 
state if the walkers are distributed uniformly among nodes, A^ 1 = —(-^)r]iA(pij) = 
— (^)(2x — l)A(pjj). For the vanishing links pik = 0(k ^ the second part of the 
right hand side of equation IB. 51 is zero, and by assuming the network in its steady 
state the variation is as A^- = —(j^)r}iA(pij) = —(-^)(2x — l)A(py). This stationary 
state is stable if x > 0.5. When x = 0.5, the solution of equations [6] and [7] is critical. 
The simulation results reveal that weight distributions are as power-law with scale-free 
properties, and even after long time-steps network doesn't reach steady state. 
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